Bootstrap Standard Error Estimates for Linear Regression
نویسنده
چکیده
Standard errors of parameter estimates are widely used in empirical work. The bootstrap often can provide a convenient means of estimating standard errors. The conditions under which bootstrap standard error estimates are theoretically justified have not received much attention, however. This article establishes conditions for the consistency of the moving blocks bootstrap estimators of the variance of the least squares estimator in linear dynamic models with dependent data. We discuss several applications of this result, in particular, the use of bootstrap standard error estimates for bootstrapping Studentized statistics. A simulation study shows that inference based on bootstrap standard error estimates may be considerably more accurate in small samples than inference based on closed-form asymptotic estimates.
منابع مشابه
Liu Estimates and Influence Analysis in Regression Models with Stochastic Linear Restrictions and AR (1) Errors
In the linear regression models with AR (1) error structure when collinearity exists, stochastic linear restrictions or modifications of biased estimators (including Liu estimators) can be used to reduce the estimated variance of the regression coefficients estimates. In this paper, the combination of the biased Liu estimator and stochastic linear restrictions estimator is considered to overcom...
متن کاملBootstrap Partial Linear Quantile Regression and Confidence Bands∗
In this paper uniform confidence bands are constructed for nonparametric quantile estimates of regression functions. The method is based on the bootstrap, where resampling is done from a suitably estimated empirical density function (edf) for residuals. It is known that the approximation error for the uniform confidence band by the asymptotic Gumbel distribution is logarithmically slow. It is p...
متن کاملCan we trust the bootstrap in high-dimension?
We consider the performance of the bootstrap in high-dimensions for the setting of linear regression, where p < n but p/n is not close to zero. We consider ordinary least-squares as well as robust regression methods and adopt a minimalist performance requirement: can the bootstrap give us good confidence intervals for a single coordinate of ? (where is the true regression vector). We show throu...
متن کاملFast robust estimation of prediction error based on resampling
Robust estimators of the prediction error of a linear model are proposed. The estimators are based on the resampling techniques cross-validation and bootstrap. The robustness of the prediction error estimators is obtained by robustly estimating the regression parameters of the linear model and by trimming the largest prediction errors. To avoid the recalculation of timeconsuming robust regressi...
متن کاملFast and stable bootstrap methods for robust estimates
The standard error and sampling distribution of robust estimates can, in principle, be estimated using the bootstrap. However, two problems arise when we want to use bootstrap with robust estimates on moderately large data sets: the bootstrap estimates may be unrealiable because the proportion of outliers in many bootstrap samples could be higher than that in the original data set, and the high...
متن کامل